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SUMMARY 



This report describes the initial phase of a continuing research 
program dealing with creative behavior which involved the development 
of a test of creative problem solving. 

The objectives of the research program are to collect more infor- 
mation about creative behavior and to apply this information to the 
production of educational materials and procedures. The objective of 
this study was to develop a test which could be used in the continuing 
research program. 

A multivariate interpretation of creative problem solving which 
is to be employed in the research program is outlined. Definitions, 
assumptions, critical variables, and a research strategy are described. 

Five test problems were selected according to several criteria 
for a test titled the Creative Design Test. Reliability and validity 
data were collected for the test, and an experiment was conducted using 
the test. Two variations of two prior solution examination variables 
were studies: high and low variety of prior solution and high and low 

originality of prior solution. 

The major results were: 

1. An acceptable scoring and Interproblem reliability was achieved 
on three of the five problems. 

2. No construct validity was obtained from teacher ratings of 
creative performance in class or from a comparison of design 
students (the students for whom the tests were designed) and 
a group of non-design students. 

3. Meager evidence of construct validity was obtained from corre- 
lations with two of Torrance's tests and four of Guilford's 
tests. 

4. No support was obtained for predicted relationships between 
performance on the Creative Design Test and (1) amount of 
problem- related knowledge possessed, and (2) whether syste- 
matlc or non- systematic problem solving procedures were 
employed. 

5. Variations in the variety and originality of prior solutions 
examined — and whether or not prior solutions are examined — 
was found to make little difference in performance on the CDT. 

Subsequent research will Involve (1) further attempts to obtain 
validity for the three more reliable problems; (2) determination of the 
relationships between CDT and several other tests; and (3) multivariate 
experiments with variables which have been shown to have a powerful 
Influence on creative problem solving. 



CHAPTER 1 



INTRODUCTION 



This research report describes the initial phase of a continuing 
investigation of creative behavior. In this first phase a test of 
creative problem solving was constructed and field-tested. 

The major premise upon which this research program was initiated 
was the desirability of more continuing, systematic research programs 
dealing with creativity. The work of Guilford (1962), Torrance (1964), 
Parnes (1960), Mednick (1962), and Maltzman (1960) gives evidence of 
the value of such research programs, and the Importance of creativity 
as an area of study is well established both from a theoretical frame 
of reference and for the practical purpose of developing ways of shaping 
and maintaining creative performance. 

The general objectives of this continuing research program are (1) 
to systematically collect, organize, and communicate information 
regarding the explanation, prediction, and control of creative problem 
solving behavior, and (2) to design, develop, and field-test instruc- 
tional materials (programed instruction, handbooks, practice exercise 
units, etc.) applying the findings from this and other research programs. 

The first effort in this research program, which is reported here, 
was the development of a test of creative problem solving. Although 
several creativity tests already existed, it was considered desirable 
to develop a reliable and valid test which is consistent with the 
research program within which it is to be used. Following are the 
definitions, assumptions, relevant variables, and the research strategy 
for this research program. 



Research Program 



A Definition of Creative Problem Solving 

1. A problem is a situation in which a person is required to make a 
response to achieve a particular goal by making a response which 
he has not previously made and which he has not previously experi- 
enced being made. 

2. Problem solving is the behavior, both observable and non- observable 
(thinking), which a person engages in to produce a response which 
solves a problem. 

3. A solution to a problem is a response which achieves the particular 
goal which was required for the problem to be considered solved. 
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4. Thus, a solution which solves a problem must be an original solu- 
tion for the problem solver since he has not made it previously. 

5. Creative problem solving is distinguished from general problem 

solving in two ways: (a) in creative problem solving there are 

several possible solotions to a problem, while in general problem 
solving only one solution is possible; and (b) in creative problem 
solving two criteria are used to judge solutions: (1) whether the 

solution solves the problem, and (2) the degree of originality of 
the solution. With general problem solving only the criterion of 
solution mccess is used. 

6. The degree of originality of a particular solution is based on the 

extent to which the solution differs from solutions to the same 
problem produced by other pe' If it differs from most of the 

other solutions, it is const ■ < -a more highly original than if it 
is similar to other solutions. However, if each of the ather 
solutions with which a particular solution is compared is quite 
different from all other solutions, then all solutions must be 
considered equally original and thus a relative degree of origin- 
ality does not exist. Thus, there must be some similarity among 

some of the other solutions to obtain a relative scale of originality. 

7. The number of other solutions with which a particular solution is 
compared Influences the degree of originality associated with a 
solution as well as the confidence placed in an originality assess- 
ment. If the solution is found to be different from 100 other 
solutions, then it can be considered more original than if it is 
compared with and found different from only 10 other solutions. 

8. The qualitative characteristics of the people producing the other 
solutions also affect the validity of an originality assessment. 

A toy design judged to be original whan compared with a group of 
professional toy designers would be considered a more valid esti- 
mate of originality than if the comparison was with the toy designs 
of a group of college freshmen English majors. 



Some Assumptions about the Nature of Creative Problem Solving 
Creative problem solving ability is: 

1. determined by genetic endowment and by experience. 

2. possessed by everyone to a greater or lesser degree. 

3. modifiable through typical behavior control techniques (reinforce- 
ment, practice, extinction, etc.). 

4. expressed in almost all occupations and activities (art, science, 
housekeeping, teaching, etc.). 
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5. a stable enough trait to render it subject to measurement with 
traditional psychometric procedures. 

6. different from what is measured by intelligence tests (!•«•» knowl- 
edge recall plus application, analysis, and evaluation skills) 
primarily due to the emphasis on skills of transfer and synthesis in 
addition to the knowledge and skills measured by Intelligence tests. 



Indepen dent Variabl es Wh ich Influence Creat ive Problem Solving 

Since there is comparatively little empirically- derived information 
regarding creative problem solving, it is considered premature to 
attempt to construct elaborate mathematical theories to organize and 
relate the facts. Nevertheless, some means for guiding the systematic 
collection of data is needed. Following is a specification of variables 
which are thought to influence creative performance. Some of the 
variables have been found to influence creativity (althoug e re 
ability of such findings is often questionable) while others lack 

empirical support. 



The way the list is interpreted is that differences in creative 
problem solving performance are to some extent a function of each of tne 
variables on the list. In other words, each of the variables “counts 
for a significant portion of the variance in creative problem solving. 
Thus, given quantitative knowledge of all these variables for a group 
of subjects and a regression equation with valid weights for 
variable, it should be possible to predict with considerable accuracy 
the creative performance of the individuals in the group. This multi- 
variate approach is based on the multiple linear regression 7® • 
procedures of Kelly, et al. (in press) and Bottenberg and Ward (1963). 
Another similar approach is Hinton's (1968) recent model for studying 
creative problem solving. 



Creative Problem Solving Variables 
I, Pre- Problem Experience Variables : 

A. Experiences with long-term effects (reinforced practice with 
brainstorming , training in visualization, synectics training, •) 

B. Experiences with short-term effects (examining prior solutions, 
remote association training, etc.) 

II, Problem- Solver Variables : relatively stable characteristics of 

individuals. 

A. Knowledge and skills 

1. General (I.Q., aptitudes, critical thinking ability, short- 
term memory, etc.) 
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2. Specific — related to problem (physics knowledge for 
physics problems, skill in solving problems requiring 
hueristic methods, etc*) 

B. Attitudes — toward a specific problem, problem solving in 
general* 

C. Motivation — for solving a specific problem, for solving 
problems in general* 

D. Personality (self-confidence, tolerance for ambiguity, autonomy, 
etc.) 

E. Sex 

III. Problem Solving Context : 

A* Physical context (time allotted, materials available, visual and 
auditory distraction, temperature, testlike versus non-testlike 
conditions, information-gathering potential, opportunity to 
test possible solutions) 

B. Psychological context — incentive ior solving (to achieve 
personal goal, money, course requirement) 

IV. Problem Solving Procedure Variables ! 

A* Non- systematic (random association, etc*) 

B. Systematic (inductive, attribute listing, synectics, morpho- 
logical analysis, etc.) 

V. Problem Variables ; 

A. Subject matter 

1. General (unusual uses, anagrams, remote associates test, 
Maler two- string problem, etc*) 

2. Specific (Owen's creative machine design tests, Hyman's test 
for engineers, economic problems, problems in biology, etc.) 

B. Problem presentation (instructions, problem definition, written 
versus actual, experimenter) 

C. Form of response required (written, oral, construction, perfor- 
mance, illustration) 

D. Number of possible solutions (one - general problem solving; 
two or more * creative problem solving) 

E. Criteria for success (functional effectiveness, originality). 
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A visual model of the five classes of variables is shown in Figure 1 
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Figure 1. Five Classes of Variables in Creative Problem Solving 




For most of these variables it is known, or strongly suspected, 
that the variable has some influence on some types of creative perfor* 
mance. For example, students with high critical thinking ability are 
typically better problem solvers than students with low critical think- 
ing ability; students who use brainstorming techniques will tend to 
produce more original solutions than students not using brainstorming; 
and non- test like conditions may be more conducive to creativity than 
test like conditions. But the kind of information which is not known is 
whether the use of brainstorming has a constant facultative effect 
on students of varying degrees of critical thinking ability (or with 
varying degrees of motivation, or knowledge about the task, etc.) under 
both test like and non- test like conditions. 

Rather than holding constant all variables except one — say, 
whether brainstorming was or was not used — the approach here is to 
obtain values for each relevant variable and to determine whether the 
differences between groups attributable to the brainstorming versus 
non- brainstorming treatment accounts for a significant portion of the 
variance in problem solving over and above the portion of variance 
accounted for by the other variables. 



Research Strategy 

The basic research strategy to be followed is one of (1) selecting, 
and/or developing and refining valid and reliable descriptive measures 
of each of the Independent variables (e.g., critical thinking, moti- 
vation, physical context, problem solving process, etc.); (2) collecting 
data on the relationship among the Independent variables and valid and 
reliable measures of creative problem solving; and (3) eventually 
obtaining weights for each Independent variable which will permit highly 
reliable prediction and control of creative performance. 



Test Development 



As previously mentioned, the first phase of this research program 
required the development of a test for use in exploring the parameters 
of the previously described variables. The reason that existing tests 
such as Guilford's or Torrance's were not used is that these tests lack 
external validity, i.e., they are frequently unlike any common problem 
solving situation due to their brevity, testlike characteristics, 
artificiality, and lack of occupational or subject matter specificity. 
Thus, it was determined that a set of criteria should be developed to 
insure that similar deficiencies in external validity would be avoided 
in the new test. 

The first decision regarding the test was the selection of an occu- 
pational subject area for the test. General design as taught by the 
Department of Design at S.I.U. was selected as the subject area because 
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(1) creative problem solving is the primary educational objective of 
the program; (2) the subject matter domain is quite broad (e.g., city 
planning, systems analysis, graphic design, product design); and (3) 
the experimenter was familiar with the objectives and curriculum of 
the program. The details of the test development are described in the 
next two chapters. 



Field Test Experiment 



As part of the first phase of the research program, an experiment 
was conducted to operationally test the newly developed creativity 
instrument. The variable chosen to investigate was in the short* term, 
pre-problem experience" category: examining prior solutions. One 

dimension of this variable — positive versus negative evaluation of 
prior solutions — has been explored and the general findings are that 
positive evaluation is superior to negative (Hyman, 1961; Torrance, 
1964). Hyman (1961, 1964) has also investigated the variety of prior 
solutions examined and obtained mixed effects, and the commonness of 
prior solutions and found no effects. But in neither experiment was 
the variety and originality of prior solutions manipulated at the same 
time. In an attempt to provide further knowledge regarding these 
variables, an experiment was conducted in which all subjects employed 
constructive evaluation (since it has generally been found to be 
superior to negative evaluation) and to manipulate only the variety and 
originality (commonness) of prior solutions. The experiment required 
four experimental groups, one for each extreme variation of the two 
variables: (1) high variety, high originality; (2) high variety, low 

originality; (3) low variety, low originality; and (4) low variety, 
high originality. 

In addition to manipulating these variables, Crt a were collected 
from a sample of subjects used in the test development phase regarding 
the relationship between their creative problem solving performance, 
their problem- related knowledge, and their problem solving process used 
in solving problems. 

The procedures followed in the experiment are described in the 
next chapter. 



Research Questions 



The specific research questions which this study was designed to 
answer are as follows: 

l. Scorina Reliability. How reliable is the scoring procedure for 
the Creative Design Test (CDT) (the test developed in this study)? 
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2. Interoroblem Reliability . What is the relationship among the 
problems on the CDT? 

3. Intercr Iter Ion Relationship . What Is the relationship among the 

CDT criteria: fluency, felxlblllty, originality? 

4. Construct Validity . What Is the relationship between subjects' CDT 
scores and the average of three design Instructors' ratings of the 
subjects on creative design performance In design courses? 

5. Construct Validity . To what extent does the CDT measure similar 
characteristics as two of Torrance's tests and four of Guilford s 
tests? 

6. Construct Validity * Do design majors do better on the CDT than 
students majoring In another field In which little or no emphasis Is 
placed on creative problem solving? 

7. Theory Testing * What Is the relationship between the CDT and (1) 
the amount of problem* re la ted knowledge possessed (2) the degree 
of knowledge possessed regarding the criteria for solutions 
originality; ani (3) the use of a systematic versus a non- systematic 

problem solving process? 

8. Experimental Treatment Effects . . Does examining prior solutions of 
differing degrees of originality and variety Influence performance 

on the CDT? 
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CHAPTER 2 



METHOD 



Test Development 



The first step in developing problems for the Creative Design Test 
was to establish the following eleven criteria to serve as a guide in 
selecting problems. 



Criteria for Problem Selection 

1. Scoring Criteria ? (Construct validity) The problem must have two 

scoring criteria: (1) an effectiveness dimension; and (2) a 

creativity dimension, l.e., originality, fluency, and/or flexibility. 
The scoring procedure must achieve .90 or better lntra- and inter- 
scorer reliability. 

2. Occupational Relevance : (External validity) The problems must be 

similar to problems performed in a particular discipline (indus- 
try 1 design) so that subjects will be able to draw on previous 
experiences and training to solve the problem. The problems should 
Involve matters related to the University -- the current environ- 
ment of the subjects. (External validity — subjects' performance 
on the experimental problems should be similar to their performance 
on actual design problems.) 

3. Realism : (External validity) The problems must closely approxi- 

mate actual problems solved by the subjects in their occupation. 

4. Variety of Solutions : (Construct validity) Each problem must have 

a variety of possible solutions. 

5. Problem Solving Time : (External validity) Adequate time must be 

provided for each subject to solve the problems to his own satis- 
faction. The problems must be long enough to avoid sampling spon- 
taneous response tendencies, but not so long as to be impractical 
as part of an experimental battery of tests. Roughly something 
between 13 minutes and four hours. 

6. Problem Solving Context : (External validity) The conditions under 

which the problems are solved should be something other than typical 
classroom testing conditions. The subjects should be individually 
Isolated, but permitted to take breaks, smoke, drink coffee, etc., 
as they desire. 
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7. Resource Materials : (Experimental control) All materials and 

information to be used in performing the problems must be provided. 
Subjects should not be permitted to bring in other materials or 
equipment or to seek out information not provided. 

8. Pre- Problem Solving Manipulation : Problems must offer the possi- 

bility for exposing subjects to pre-problem solving treatments , 
for example , examining prior solutions or studying the crltecie 
for success. 

9. Reliability : The problems should have at least moderate reliability 

-- low- to- moderate positive correlation among the various problems. 

10. Concept versus Product ; (Construct validity) The concepts or 
ideas which subjects produce should be given prime consideration in 
evaluation as opposed to the form (neatness, presentation elegance, 
literary form, drawing, or construction quality) of the subjects* 
solutions. 

11. Problem Variety : (Content validity) The problems selected for the 

test should sample a variety of response modes (writing, drawing, 
model building) and a variety of types of problems (book cover 
design, student room design, design of a campus communication 
system, development of a commencement exercise plan). 

Employing the above criteria, fourteen problems were developed; and 

from these five were selected for use in the Creative Design Test. 

Copies of the selected problems follow on the next pages. 
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PAPER PRODUCT 



The S.I.U. Student Government has developed a plan for conducting 
a series of teacher-student seminars dealing with critical Issues 
on the local , national, and international levels. However, to 
carry out this plan, funds are needed for renting auditoriums, 
advertising, refreshments, printing programs, and so on. Your 
task is to help raise some money for this purpose by designing 
ten marketable items to sell to S.I.U. students. Fortunately, 
the Student Government has a large supply of paper, 8V x 11 
sheets of white, blank, mimeograph paper from ldiich you are to 
make your products. Your only restriction is that the available 
paper must be the principle material used in each product. 

Your ideas for paper products will be judged on three criteria: 

1. Variety: Your ten products should be as varied as 
possible; in other words, each product should be as 
different from each other product as possible. 

2. Originality: Each of your products should be unlike 

any products other S.I.U. design students would design. 

3. Sales Potential : Each of your ten products should appeal 

to S.I.U. students; that is, each product should be some- 
thing that S.I.U. students would be likely to buy. 

You should provide a short verbal description of each product and 
a rough sketch when appropriate. 

There is no time limit; however, you should be able to come up 
with ten products in about one hour. 



SCHOOL PRIDE 



Problem* It has recently come to the attention of the S.I.U. admini- 
stration that both the students and the faculty at S.I.U. possess 
very little pride In their Institution* This condition Is considered 
to have a negative Influence on the general quality of education at 
S.I.U. 



Your task Is to suggest ten different plans to strengthen the pride of 
both faculty and, students In S.I.U. 

Your plans will be Judged on three criteria: 

1* The potential effectiveness of each of your plans, that is, 
whether the plan offers a reasonable possibility of In- 
creasing student and faculty pride. 

2. The variety of your ten plans. Each plan should be as 
different from the others as possible. 

3. The originality of each plan. Each plan should be as dif- 
ferent from those produced by other S.I.U. design students 
as possible. 

A short verbal description of each of your plans should be sufficient. 
Number each of your plans. There Is no time limit; however, you 
should be able to produce ten plans In about one hour. 
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INSTRUCTION TIME 



Problem : It has come to the attention of the S.I.U. administration 

that a considerable amount of valuable instruction time Is lost each 
day by faculty and students in getting to and from classrooms, offices 
and dormitories. Your task is to suggest as many original ways as you 
can to solve this problem. 

Your ideas will be judged on these ctitetia: 

1. The total number of ideas you produce. The more the better. 

2. The variety of the ideas you produce. The more different 
types of ideas you produce the better. 

3. The originality of each of your ideas, that is, how unusual 
or rare each of your ideas is as compared to ideas produced 
by other S.I.U. design students. 

4. Each of your ideas must be a feasible solution to the problem 

A short verbal description for each idea will be sufficient. Number 
each idea. There is no time limit; however, you should be able to 
exhaust your supply of ideas in about one hour. 



LAUNDROMAT 



This is a test of your ability to think of creative ways to increase 
the amount of business done by a self-service laundry in Carbondale. 

Your task is to list all of the different ways you can think of to 
Influence S.l.U. students to use "Edward's Laundromat" rather than 
a number of other available self-service laundries. 

The Edward* s Laundromat is in a building that has a 40 x 50 floor 
space. There are 20 washers, 10 dryers, a row of tables f 0 r folding 
clothes, some carts for use in taking clothes out of the dryers, an 
automatic money changer, a soap vending machine, a sink, a pay tele- 
phone, vending machines for drinks, candy, and cigarettes, and several 

chairs. 

You may spend up to $5000 for any one of your plans. 

You are free to try anything to get students to do their laundry at 
Edward's except the following: 

1. Move the building (and you must assume that Edward's is 
located the same distance from the campus as the other self- 
service laundries in Carbondale) . 

2. Make major architectural changes in the building. 

3. Change the amount of money required by the washera and 
dryers . 

Your ideas will be judged on three criteria: 

1. The total mimhgr of different ideas you produce. The more 
the better. 

2. The originality of each of your ideas, that is, the more 
unusual or rare each of your ideas is as compared to ideas 
produced by other S.l.U. design students, the better. 

3. The variety of your ideas. The more different types of ideas 
you produce the better. 

4. The feasibility of each of your ideas, that is, trtiether the 
ideas could actually be implemented and whether there is some 
reasonable promise of the idea resulting in an increase in busi- 
ness. 

A short verbal description for each plan will be sufficient. Number each 
idea. There is no time limit; however, you should be able to exhaust 
your ideas in about one hour. 
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LIBRARY MATERIALS 



Problem ! The periodical* and reference materials In the Morris Library 
are constantly being marked up and having pages torn out; and volumes 
are being stolen. Replacing these materials Is extremely costly, and 
a plan Is needed to eliminate — or at least reduce — this problem. 

Your task Is to think of several different solutions to this problem. 

Your solutions will be judged on four criteria: 

1. The ^tjrijua&er of different solutions you produce. The 
more the better. 

2. The originality of each of your solutions, that Is, the more 
novel each of your solutions Is as compared to solutions pro - * 
duced by other 8 . 1 . 0 . design students, the better. 

3 . The vgrletg of your solutions. The more different types of 
solutions the better. 

A. The effectiveness of each of your solutions. The more effective 
your solution is In reducing the damage and theft problems 
while providing efficient periodical and reference material 
service, the better. Your solutions will also be evaluated 
for cost and technical practicality. The less a solution 
costs and the more technically reasible a solution Is, the 
better. 



A short verbal description of your solutions will be adequate. Humber 
each solution. 

There Is no time limit; however, you should be able to exhaust your 
solutions In about one hour. 
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Test Scoring 

The first step in scoring the solutions vis to determine whether 
each solution was a plausible (i.e., technically or logically feasible) 
solution to the problem. The implausible ones were eliminated. 

The three creativity criteria were scored in the typical manner -- 
fluency ■ the total number of tolutlons produced; flexibility • the 
number of different categories in which solutions were produced; and 
originality * each solution's statistical Infrequency based on all the 
solutions produced by the group (weights are 9 points for unique 
solutions , 8 points for solutions which two students had produced, and 
so on down to 0 points for solutions which ten or more students pro- 
duced) . Four measures of originality were tried: the high weight, 
the average of the three highest weights, the average of the five 
highest weights, and the average of all weights. The five highest 
average was selected as it appeared to offer the most reliable and 
representative index of originality for most subjects, l.e., the 
majority of subjects produced about five solutions which received 
originality scores of one or more and the remainder of their solutions 
received zero scores. 

Another step in scoring solutions was to eliminate any solutions 
which duplicated any of the prior solutions which the subjects examined 
prior to producing solutions. 

Although originality is considered the basic criterion (in addition 
to solution success) of creative problem solving according to the 
definitions in Chapter 1, the two other criteria, fluency and flexi- 
bility, which are frequently associated with creative behavior, were 
also explored in this study. 



Test Data Collection 

To obtain reliability and validity data (research questions 1 
through 6), half of the students majoring in design at Southern Illinois 
University (N«93) were invited to take the tests and were offered $2 
per hour to complete the six- to seven~hour testing battery. Forty-one 
students started the battery; however, only 25 completed all instru- 
ments, which, in addition to the Creative Design Test, Included (1) two 
of Torrance's tests: Product Improvement and Picture Completion; (2) 

four of Guilford's tests: Assoclatlonal Fluency, Consequences, Pertinent 

Questions, and Alternate Uses; (3) a form to obtain an estimate of the 
amount of problem- related knowledge each student possessed for each 
problem (shown in Appendix A); (4) a form to obtain the degree of 
knowledge each student possessed regarding the criteria for solution 
originality for each problem (Appendix B); and (5) a form for students 
to indicate whether they used a systematic or non- systematic problem 
solving procedure in solving each problem (Appendix C). The order in 
which the tests and forms were completed was the same as that above. 
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The tests end forms were completed et desks end tebles in the foyer 
outside the experimenter's office* The students were tested Individual 
end completed the testing in verying schedules from one-hour blocks 
over three weeks' time to three-hour blocks in two deys* 

Three design Instructors who hed taught most of the students in the 
Depsrtment of Design were selected to rete the students' creetlve deslg 
performance In design courses* The Instructions end forms used to 
record the ratings are in Appendix D* 

The non- design student group (research question Numoer 6) was com- 
posed of 45 students enrolled In two introductory educational psycholog 
classes* They were selected and tested In the same manner as were the 
design students* 



Experiment 



The other half of the students majoring In design (those not used 
in the preceding phase of the study) were Invited to participate In 
the experiment (N»93). Sixty- two students began the testing, but only 
31 completed all tests* 

The testing procedure and conditions for this group were Identical 
to those employed with the preceding group, except that prior to 
solving the Creative Design Test problems, the experimental subjects 
read and responded to ten prior solutions* There were four variations 
of prior solutions, one of which was employed for each of four randomly 
assigned groups* The prior solution variations were: 

Group 1* High variety - high originality 

Group 2* High variety - low originality 

Group 3* Low variety - low originality 

Group 4* Low variety - high originality 

The prior solutions were obtained from design students who had com- 
pleted the problems In a pilot phase of the project, and the originality 
classification was based on the weights obtained for the group used In " 
the test validation* An example of the prior solution forms is contain* 
In Appendix E* 

The data were collected during the spring quarter and several 
attempts were required to Induce students to complete the battery* 
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CHAPTER 3 



RESULTS 



In this chapter each research question stated in Chapter 1 is 
restated and followed by an hypothesis (when relevant), the question 
stated in statistical terns, the analysis performed to answer the 
question, the results, and a brief interpretation of the results# 



Research Question Ho. 1 - Scoring Reliability : 

How reliable is the scoring procedure for the Creative Design Test! 
Hypothesis : none stated# 

Statistical Question : How many discrepancies in categorization are 

there between (1) the same scorer's categorisation of the same solutions 
twice, and (2) two different scorers' categorizations of the same 
solutions? 

Analysis : A count of the number of discrepancies in categorization of 

a sample of solutions, within and between scorers# Also correlations 
on some of the data# 

Results : After several revisions and refinements of the originality 
and flexibility categories, two scorers were able to Independently 
categorize approximately 94 of 100 solutions into the same categories 
for the Instruction Time, Laundromat, and Library Materials problems. 

A discrepancy in inter* scorer categorization of approximately 11 of 100 
solutions was obtained on the School Pride problem and 19 of 100 for 
the Paper Product problem# In all categorization discrepancies, the 
conflict could be resolved and each solution categorized into one 
category. Thus, the differences between scorers were a matter of errors 
in judgment by the scorers and not a function of overlapping categories# 
It appeared that with more extensive scorer training, a higher level of 
inter- scorer reliability could be achieved# 

It should be noted that discrepancies in assigning solutions to 
categories had no effect on the fluency criterion score and a fairly 
minor Influence on the flexibility and originality criteria scores# 

For example, with ten category discrepancies on the School Pride 
problem, there were only two cases in which the flexibility score was 
affected, and for those two the difference was only one point# Similarly 
for the originality criterion of the School Pride problem, with 11 
discrepancies of 100 solutions, the intra* scorer r was #84# An intra- 
scorer reliability check with the Library Materials test turned up a 
4 per cent categorization discrepancy, but identical originality scores 
for an r of 1.00# 
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Interpretation: 



The scoring reliability for three of the problems: Instruction 

Time, Laundromat, and Library Materials, is considered adequate while 
further refinements in scoring the Paper Product and School Pride 
problems appear desirable. 
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Research Question No. 2 ■ Interproblem Reliability ! 

What is the relationship among the Creative Deaign Test problems? 

Hypothesis ; There will be a statistically significant positive 
relationship between performance on each criterion among the five test 
problems* 

Statistical Question ; What is the correlation between the five problems 
for each of the three criteria? 

Analysis : Correlation. 

Results: The statistically significant correlations between problems 
for each criterion are shown in Table 1. 



Table 1 

Statistically Significant Correlations 
Between Problems on the Three Criteria 



Fluency 


Problems 




N 


r 


Slg. 


Instruction Time 


Laundromat 


63 


.67 


.005 


Instruction Time 


Library Materials 


60 


.76 


.005 


Laundromat 


Library Materials 


61 


.65 


.005 


Flexibility 


Problems 




N 


r 


Slg. 


Instruction Time 


Laundromat 


63 


.44 


.005 


Instruction Time 


Library Materials 


60 


.35 


.005 


Originality 


Problems 




N 


r 


Slg. 


Instruction Time 


Laundromat 


64 


.31 


.01 


Instruction Time 


Library Materials 


55 


.37 


.005 


Laundromat 


Library Materials 


56 


.36 


.005 
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For most of the criteria subjects performed similarly, in relation 
to each other, on the Instruct ion, Time, Laundromat, and Library Materials 
problems. There was little or no relationship between performance on 
the Paper Product problem and the other four problems or between the 
School Pride problem and the other four problems. 



Interpretation ; 

It appears that three of the problems: Instruction Time, Laundromat, 

and Library Materials, provide similar measures of the three criteria: 
fluency, flexibility, and originality. Performance on the Paper Product 
and School Pride problems apparently is unrelated to each other and to 
the other three tests. Perhaps what makes the Paper Product problem 
different from the others is that it is less of a "real” problem and 
more of an exercise. The School Pride problem, on the other hand, may 
differ from the other in that the problem is less concrete, and, as a 
result, the criteria for success are more difficult to specify. 



Research Question No. 3 - Intcrcrlterlon Relationship: 



What it the relationship among the Creative Design Test criteria: 
fluency, flexibility, and originality? 

Hypothesis: There will be statistically significant correlations 
between the criteria for each problem and for the total test. 

Statistical Question: What is the correlation between the criteria for 
each problem and on the total test? 

Analysis : Correlation. 

Results : The correlations between criteria for each problem and the 
total tests are shown in Table 2 and Table 3, respectively. 



Table 2 

Correlations between Criteria for Each Creative Design Test Problem 



Problem 


Criteria 




N 


r 


Sife 


Paper Product 


Flexibility 


Originality 


103 


.35 


.005 


School Pride 


Flexibility 


Originality 


94 


-.12 


— 


Instruction 


Fluency 


Flexibility 


70 


•63 


.005 


Time 


Fluency 


Originality 


69 


.63 


• 005 




Flexibility 


Originality 


69 


.42 


.005 


Laundromat 


Fluency 


Flexibility 


65 


•54 


.005 




Fluency 


Originality 


63 


.54 


•005 




Flexibility 


Originality 


63 


.16 




Library 


Fluency 


Flexibility 


61 


• 56 


• 005 


Materials 


Fluency 


Originality 


56 


.72 


.005 




Flexibility 


Originality 


56 


.57 


•005 



Statistically significant relationships were found between fluency 
and originality and between fluency and flexibility for all three tests 
in which fluency was a criterion. Such relationships were also obtained 
for flexibility and originality for the Paper Product, Instruction Time, 
and Library Materials problems but not for the School Pride and 
Laundromat problems. 
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Table 3 



Correlations between Crlterie Tote Is for Creetlve Design Test 



Criteria 


N 


r 


Slg. 


fluency 


flexibility 


59 


.55 


.005 


fluency 


originality 


59 


•60 


.005 


flexibility 


originality 


58 


.49 


.005 



The correlations between criteria for the total Creative Design 
Test were all slgnlf leant • 



Interpretation : 

The criteria of fluency, flexibility, and originality apparently 
provide similar measures of performance on the Creative Design Test. 
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Research Question No. 4 - Construct Validity (Instructors' Ratings) : 



What is the relationship between students' scores on the Creative Design 
Test and the average of three design instructors' ratings of the students 
on creative design performance in design courses? 

Hypothesis : There will be positive and significant correlation between 
the Creative Design Test scores and the creative design performance 
ratings. 

Statistical Question : What is the correlation between the criteria 
scores on the Creative Design Test and the instructors' creative design 
performance ratings? 

Analysis : Correlations between scores and ratings. 

Results : The intercorre let ions between the three design Instructors' 

ratings were .18, .25, and .32, which suggests that Instructors were not 
in close agreement regarding the creative design performance of their 
students. The correlations between ratings and scores are shown in 
Table 4. 



Table 4 



Correlations between Design Instructors' Ratings 
Of Creative Design Performance and Scores on the Creative Design Test 



Design Inst. 
Ratings 


Problem 


Criterion 


N 


r 


Si*. 


Ratings 


Paper Product 


Flexibility 


51 


.07 








Originality 


51 


.17 


•••• 


Ratings 


School Pride 


Flexibility 


45 


.044 


.... 






Originality 


45 


.26 


.... 


Ratings 


Instruction 


Fluency 


40 


.28 


.... 




Time 


Flexibility 


40 


.28 


.... 






Originality 


39 


.32 


.05 


Ratings 


Laundromat 


Fluency 


37 


.13 


«««• m 






Flexibility 


37 


.01 


.... 






Originality 


37 


-.08 


.... 


Ratings 


Library 


Fluency 


35 


.06 


.... 




Materials 


Flexibility 


35 


.10 


.... 






Originality 


33 


.14 


.... 


Ratings 


Total CDT 


Fluency 


59 


.08 


.... 


Ratings 


Total CDT 


Flexibility 


58 


.23 




Ratings 


Total CDT 


Originality 


60 


.26 


.02 
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Except for the crlterle on the Instruction Tine problem end the 
originality criteria for the total Creative Design Test, there were no 
significant relationships between design Instructors' ratings and per- 
formance on the Creative Design Teat. 



Interpretation : 

Since the Creative Design Test problems are similar to those used 
in the design education program from which the students and Instructors 
were selected, the reason for the lack of agreement between the ratings 
and Creative Design Tert scores may be in the different criteria 
employed to evaluate problem solutions. The criteria of fluency and 
flexibility are rarely, if ever, used in evaluating student performance 
in the design education program, and although the originality of students 
solutions Is frequently evaluated. It Is typically considered of less 
significance than the functional effectiveness of solutions. Thus, the 
different emphasis In evaluation between the test and the classroom 
could be the reason for the lack of relationship found between them. 

It seems feasible that greater effort to train the raters to rate 
students predominantly on (he creativity criteria (perhaps only 
originality rather than all three) would Improve their Inter- rater 
reliability and, as a result, also Increase the validity estimate. 
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Research Question No. a- Construct Validity (other creativity tests): 



To what extent does the Creative Design Test measure similar character- 
istics (fluency, flexibility, and originality) as two of Torrance's 
tests, Product Improvement (fluency, flexibility, and originality) and 
Picture Completion (fluency, flexibility, and originality), and four of 
Guilford's tests, Assoclatlonal Fluency, Alternate Uses (semantic 
spontaneous flexibility), Consequences (Ideational fluency and origin- 
ality), and Pertinent Questions (conceptual foresight)? 

Hypothesis : There will be a low positive correlation between related 

criteria on the tests. 

Statistical Question : What Is the correlation between the Creative 
Design Test problem criteria scores and the related factor scores on 
Torrance's and Guilford's tests? 

Analysis : Correlation. 

Results : The statistically significant correlations and correlations 

above .20 are reported In Table 5. 



Table 5 

Correlations of .20 and Above between Creative Design Test Scores 
And Scores on Other Creativity Tests (N*44) 



Paper Product Problem 


CDT Criterion 


Other Test 


r 


Slfe 


Flexibility 


Product Improvement Flexibility 


.36 


.01 


Flexibility 


Picture Completion Flexibility 


.21 


— — 


Flexibility 


Alternate Uses 


.20 


— — 


Flexibility 


Pertinent Questions 


.30 


.02 


School Pride Problem 


Flexibility 


Product Improvement Flexibility 


-.20 


.... 


Originality 


Product Improvement Originality 


.42 


.005 


Originality 


Pertinent Questions 


.20 


.... 


Instruction Time Problem 


Fluency 


Product Improvement Fluency 


.30 


.02 


Fluency 


Assoc let Iona 1 Fluency 


-.31 


.02 


Fluency 


Picture Completion Fluency 


.28 


•••• 




***• 



27 



Laundromat Problem 



Fluency 


Product Improvement Fluency 


.30 


.02 


Fluency 


Assoclatlonal Fluency 


-.20 


• « m m 


Fluency 


Picture Completion Fluency 


•31 


.02 


Originality 


Consequences Remote 


•36 


.02 


Originality 


Pertinent Questions 


.33 


.02 



Library Materials Problem 



Fluency 


Product Improvement Fluency 


.38 


.005 


F 1 "ency 


Assoclatlonal Fluency 


-.37 


.01 


Fluency 


Picture Completion Fluency 


.31 


.02 


Flexibility 


Picture Completion Flexibility 


.21 


• • m m 


Originality 


Pertinent Questions 


.31 


.02 



Creative Design Test Criteria Totals 



Fluency 


Product Improvement Fluency 


.28 


• • m m 


Fluency 


Assoclatlonal Fluency 


-.31 


.02 


Fluency 


Picture Completion Fluency 


.32 


.02 


Originality 


Product Improvement Originality 


.22 


mmmm 


Originality 


Consequences Remote 


.26 


mmmm 


Originality 


Pertinent Questions 


.48 


.005 



Interpretation : 

Four tests appear to have the most consistent relationship with the 
Creative Design Test criteria: Pertinent Questions with originality, 

Picture Completion fluency with fluency, Assoclatlonal Fluency (nega- 
tively) with fluency, and Product Improvement fluency with fluency. The 
Creative Design Test flexibility criterion appears to have the least in 
common with the other tests of flexibility. 

The negative relationship between Assoclatlonal Fluency and Creative 
Design Test fluency was unexpected and the only interpretation which 
suggests Itself is that the Assoclatlonal Fluency test is more a test 
of verbal skill and the CDT is more a test of non-verbal conceptual 
skill. Thus, design students who are better at conceptual problem 
solving tend to have poorer verbal skills, and students with less effec- 
tive conceptual problem solving skills tend to have better verbal skills. 
This condition could have occurred through reinforcement of successful 
problem solving strategies and extinction of unsuccessful strategies. 

The above relationships, particularly the first, third, fourth, 
fifth, and sixth in the Creative Design Test totals, are Interpreted as 
providing some evidence that the Creative Design Test measures similar 
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characteristics (fluency and originality) as other tests and, therefore, 
is to sons degree a valid neasure of these c.iaracterlstlcs. 

It should be noted that the Pertinent Questions test is not typically 
considered a neasure of creativity or divergent thinking. It does, 
however, appear to measure an ability which is highly related to creative 
problem solving, namely "conceptual foresight" which is defined as "the 
ability to be aware of implications in given information," and it is 
scored in the same manner as measures of fluency. Thus, its use for 
exploring what might be termed the more intellectual dimension of 
creativity appears warranted. 



Research Question No. 6 - Construct Validity (c ollege major): 



Do design majors do better on the Creative Design Testa than students 
majoring in another field in which little or no instruction and practice 
is provided in creative problem solving? 

Hypothesis : Design majors will score significantly higher than other 

majors: 

Statistical Question : Is there a statistically significant difference 

between design majors and other majors on each of the individual test 
scores? 

Analysis : Multiple linear regression analysis: Full model - weights 

for each group used vs* Restricted model » one weight for both groups* 
(This analysis produces an F-ratio identical to that produced with an 
analysis of variance and was used Instead of the analysis of variance 
due to the availability of multiple linear regression computer programs. 
The freshman design majors were eliminated from the analysis since they 
were not considered as representative of assign majors as upperclassmen 
due to their limited exposure to the design education program* 

Results: The means and standard deviations are shown in Table 6# The 

only statistically significant difference found was on the flexibility 
criterion for the Instruction Time problem* The non-majors scored 
significantly higher than the design majors, F ■ 7.81, p <*007. Two 
other comparisons approached statistical significance; design majors 
were superior on Instruction Time fluency, F ■ 3*24, p<*08, and also 
on Library Materials originality, F * 3*27, p^*07. 



Table 6 



Ns, Means, and Standard Deviations for Non-Design Majors (N*44) 
And Design Majors (N"59) on Three Creative Design Test Problems 



Test 


Criterion 


Non-Design Majors 
X SD 


Design Majors 
X SD 


Instruction 

Time 


Fluency 

Flexibility 

Originality 


8.39 3.5? 
4.89 1.81 
6.06 2.43 


9.68 4.69 
3.49 .98 
5.36 2.48 


Laundromat 


Fluency 

Flexibility 

Originality 


12.87 5.30 
4.58 1.15 
6.73 1.94 


12.66 6.53 
4.39 1.03 
6.00 2.37 


Library 

Materials 


Fluency 

Flexibility 

Originality 


7.18 2.31 
4.62 1.55 
2.89 1.70 


7.95 4.25 
5.46 2.69 
3.51 2.26 
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Interpretation : 



Apparently design majors perform no better than non- design majors 
on nearly all of the CDT criteria. Of the two possible Interpretations * 
(1) design majors are no better creative problem solvers than non-design 
majors, and (2) the CDT does not measure the creative problem solving 
skill possessed by design majors — the latter interpretation Is chosen. 



Research Question No. 7 - Theory Toting : 



What is tha relationship between each of the following three variables 
and performance on the Creative Design Test: 

1. Amount of problem- related knowledge possessed. (Data collection 
form Is In Appendix A) 

2. Degree of knowledge possessed regarding the criteria for solution 
originality. (Appendix B) 

3. The use of a systematic versus non- systematic problem-solving 
process. (Appendix C) 

Hypothesis : There will be a statistically significant positive correla- 
tion between each of the above variables and each of the Creative Design 
Test criteria. 

Statistical Question : What Is the correlation between the three variables 
and the Creative Design Test criteria? 

Analysis : Correlation. 

Results: There were no statistically significant correlations between 
the first two variables above (related knowledge and criteria knowledge) 
and the Creative Design Test criteria; and there was one significant 
correlation for the third variable: non- systematic problem solving 

process was correlated with flexibility on the School Pride problem at 
•37, p<\02. 



Interpretation : 

The most appealing explanation for these results Is that the measures 
of problem- related knowledge, criteria knowledge, and problem-solving 
process, were Invalid. And this seems to be a legitimate position to 
take In view of the self-report rating scale- type Instruments employed 
to obtain these data. These Instruments were chosen because the Idea 
of attempting to collect such data did not emerge until shortly before 
the data were to be collected, and time did not permit the construction 
of more desirable Instruments. 

Of course, It Is possible that the Instruments are reasonably valid 
and that little relationship actually exists between what they measure 
and Creative Design Test performance. But It Is considered Imperative 
to explore the above relationships again with well-validated Instruments 
before any firm conclusions can be drawn. 
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Research Quaitlon No. 8 » Experimental Treat— nt Effects: 



Dots examining prior solution* of differing dsgrsss of originality and 
variaty influanea parfornanea on tha Craativa Design Test? 

Hypo thesis ; none stated. 

Statistical Question ; Is there a statistically significant difference 
between any of the five groups (four treatment and one control) on any 
of the creative design test criteria scores? 

Analysis : Multiple linear regression analysis: Full model ■ weights 

for two groups used versus Restricted model * one weight for both groups 
combined; performed for al 1 pained .group* . 

Results : The N*s, means , and standard deviations for the four treatment 
groups and the control group are presented in Table 7. The rank order 
of group means and significant differences between omens for each 
problem and the total Creative Design Test are presented in Table 8. 

There were no significant group differences for the fluency criterion 
and only one for flexibility — on the Instruction Time problem — 
group 5, the control group, was significantly better than groups 2 and 3. 
For the originality criterion, group 1 was significantly better than 
groups 2, 4, and 5 on the Paper Product problem and on the Laundromat 
problem* On the originality criterion for the total test, groups 1 and 
3 were both superior to group 4* 



33 



o 

ERIC 



TABLE 7 
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Table 8 



Rank Order of Group Means and Significant Differences 
Between Means for Each Creative Design Test Problem 



Criterion 


Rank Order of Group Means 
12 3 4 5 


F Slg. 




Significant Differences between Means 




Paper Product 


Flexibility 1 


3 14 2 5 




NSD 






1 3 5 4 2 






1> 2 


10.87 .001 


Originality 


1> * 


7.67 .007 




LL 5 


6a78 «01 



School Pride 



Flexibility 


5 1 4 2 3 




NSD 


Originality 


3 4 15 2 




NSD 



Instruction Time 



Fluency 


5 


2 


1 


4 


3 




MSB 






5 


4 


1 


? 


3 


4.64 .04 

3.56 .06 


Flexibility 


5> 

5> 


• 




2 


3 


Originality 


5 


4 


1 


2 


3 1 




NSD 





Laundromat 



Fluency 


2 5 I 3 5 “ ” 




NSD 


Flexibility 


4 5 12 3 




NSD 


Originality 


2 3 15 4 




NSD 



Library Materials 



Fluency 


5 14 3 2 




NSD 


Flexibility 


1 5 4 3 2 




NSD 


Originality 


1 2 5 4 3 




NSD 
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CDT Totals 



Fluency 


2 5 13 4 




NSD 


Flexibility 


1 5 4 2 3 




NSD 


Originality 


1 3 2 5 4 


5.41 .02 

4.00 .05 


1 4 

3 4 



Interpretation ? 

It is apparent that little consistency exists among the treatment 
effects for the five problems. Since the prior- solution treatments are 
considered adequate expressions of each prior- solution condition (l.e., 
the number, variety, and originality of prior solutions were adequate), 
differences in prior- solution conditions, or whether prior solutions are 
examined or not, does not appear to be powerful enough to permit any 
specific treatment to be recommended over any other for other than one 
criterion on one Creative Design Test problem. These findings are con- 
sistent with the results of two previous studies: the conflicting effects 

which Hyman found with homogeneous versus heterogeneous prior solutions 
for two separate problems (1961) and the lack of effect with common 
versus unusual prior solutions for two different problems, Hyman (1964). 
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CHAPTER 4 



CONCLUSIONS 



The following things were accomplished in this study: 

1. A research program in creative problem solving was outlined in 
which (a) creative problem solving was defined, (b) Important 
assumptions regarding the nature of creative problem bolvlng were 
specified, (c) a list of variables thought to Influence creative 
performance were specified, and (d) a multivariate research 
strategy was described. 

2. A test of creative problem solving (labelled the Creative Design 
Test) was developed and the following conclusions are offered based 
on the data obtained. 

(1) An acceptable scoring reliability was achieved on three of the 
five problems in the Creative Design Test (Instruction Time, 
Laundromat, and Library Materials). 

(2) Acceptable Interproblem reliabilities were obtained for three 
of the five problems (Instruction Time, Laundromat, and 
Library Materials). 

(3) The three criteria measured on the Creative Design Test, fluency, 
flexibility, and originality, provide similar measures of 
creative problem solving performance. 

(4) No construct validity was obtained for the Creative Design Test 
from design instructors' ratings of classroom creativity. 

(5) Some evidence, though meager, of construct validity for the 
Creative Design Test was found from the relationships with 
other creativity tests. 

(6) No construct validity was obtained for the Creative Design Test 
by comparing design students' scores with the scores of 
education majors. 

(7) No support was obtained for the hypothesis that Creative Design 
Test performance was related to the amount of problem- related 
knowledge a student possessed, or that Creative Design Test 
performance was related to whether a systematic or non- systematic 
problem solving process was employed. 
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(8) Variations in the variety and originality of prior solutions 
examined -- and whether or not prior solutions are examined •• 
appears to make little difference in performance on the 
majority of the Creative Design Test problem criteria. The 
exceptions to this finding are inconsistent, and as a result, 
the prior solution variables investigated are to be tentatively 
considered of minor significance as Independent variables in 
creative problem solving. 



Based on the results of this study, the following plans have been 
made for the next phase of the research program. 

Two problems in the Creative Design Test will be dropped (Paper 
Product and School Pride) primarily because of their low scoring reli- 
ability and lack of relationship with the other three tests, and 
the fluency and flexibility criteria will be eliminated from the problem 
instructions and will not be scored on the other three problems 
(Instruction Time, Laundromat, and Library Materials). Students will 
be instructed to produce only five solutions for each problem and to 
strive only for originality. 

Further attempts to obtain construct * alldlty will be made by having 
design Instructors rate the originality of solutions to the Creative 
Design Test and also by administering the test to a non- university 
sample to determine whether university- related subject matter of the 
problems Influences performance on the test. 

Several Instruments will be administered to a sample to determine 
the amount of variance in Creative Design Test performance accounted for 
by each test. The Instruments to be Included will be measures of: 
Intelligence, critical thinking, personality, short-term memory, problem- 
related knowledge. 

Ihree variables to be manipulated in future studies Include long- 
term pre- problem experiences such as synectlcs training or programed 
instruction in morphological analysis, brainstorming training, and 
Induced incentive for highly original solutions. 
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APPENDIX A 



Form used to Obtain an Estimate of each Ss' Amour.t of 
Problem Related Knowledge 
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PAPER PRODUCT PROBLEM 



Related Knowledge 



How much knowledge do you have regarding the various aspects of the 
problem you just completed? In other words 9 how familiar are you with 
the type of problem and with the specific elements Involved In the 
problem? 

Place an "X" In the appropriate box on each of the Items below. 

1. Estimate how much you know about the variety of products which 
can be made of paper. 



More-than- A 





A Small 


A Moderate 


Average 


Considerable 


Mo 


Amount of 


Amount of 


Amount of 


Amount of 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


□ 


□ 


□ 


□ 


0 



2. Estimate how much you know about the kinds of things SIU students 
are likely to buy. 



Mo 

Knowledge 



A Small 
Amount of 
Knowledge 



A Moderate 
Amount of 
Knowledge 



More-than- 
Average 
Amount 01 
Knowledge 



A 

Considerable 
Amount of 
Knowledge 




3. Estimate how familiar you are with problems like the paper product 
problem. 



Totally 


Slightly 


Moderately 


More-than- 

Moderately 


Highly 


Unfamiliar 


Familiar 


Familiar 


Familiar 


Familiar 


□ 


□ 


p 


□ 


□ 




> 
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SCHOOL PRIDE PROBLEM 



Related Knowledge 



How much knowledge do you have regarding the various aspects of the 
problem you just completed? In other words, how familiar are you with 
the type of problem and with the specific elements Involved In the 
problem? 

Place an "X M In the appropriate box on each of the Items below* 

1 • Estimate how much you know about factors which would likely In- 



fluence how faculty and students feel about SIU* 









More-than- 


A 




A Small 


A Moderate 


Average 


Considerable 


No 


Amount of 


Amount of 


Amount of 


Amount of 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


□ 


□ 


□ 


□ 


□ 



2* Estimate how familiar you are with problems like the school pride 
problem* 



Totally Slightly 
Unfamiliar Familiar 



More-than- 

Moderately Moderately Highly 

Familiar Familiar Familiar 
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LAUNDROMAT PROBLEM 



Related Knowledge 



How much knowledge do you have regarding the various aspects of the 
problem you Just completed? In other words, how familiar are you with 
the type of problem and with the specific elements Involved In the 
problem? 



Place an "X" In the appropriate box on each of the Items below. 



1. Estimate how much you know about procedures and equipment which 
might Increase the amount of business done by businesses such as 
laundromats. 



A Small 

No Amount of 
Knowledge , Knowledge 



A Moderate 
Amount of 
Knowledge 



More-than- 
Average 
Amount of 
Knowledge 



A 

Considerable 
Amount of 
Knowledge 




2. Estimate how much you know about the kinds of things which would 
be likely to appeal to SIU students In laundromats. 



No 

Knowledge 


A Small 
Amount of 
Knowledge 


A Moderate 
Amount of 
Knowledge 


More* than* 
Average 
Amount of 
Knowledge 


A 

Considerable 
Amount of 
Knowledge 


□ 


□ 


□ 


□ 


□ 


3. Estimate how familiar you are with 
problem. 


problems like the Laundromat 


Totally 

Unfamiliar 


Slightly 

Familiar 


Moderately 

Familiar 


More* than* 
Moderately 
Familiar 


Highly 

Familiar 


□ 


□ 


□ 


□ 


□ 
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LIBRARY MATERIALS PROBLEM 



Related Knowledge 



How much knowledge do you have regarding the various aspects of the 
problem you just completed? In other words, how familiar are you with 
the specific elements involved in the problem? 

Place an "X" in the appropriate box on each of the items below. 

1. Estimate how much you know about procedures for storing and using 



library materials. 
A Small 


A Moderate 


More-than- 

Average 


A 

Considerable 


No 


Amount of 


Amount of 


Amount of 


Amount of 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


□ 


□ 


D 


□ 


□ 



2. Estimate how much you know about the kinds of preventative measures 
which would probably be effective with SIU students. 



More- than- A 





A Small 


A Moderate 


Average 


Considerable 


No 


Amount of 


Amount of 


Amount of 


Amount of 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


□ 


□ 


p 


P 


□ 



3. Estimate how familiar you are with problems like the library 
materials problem. 



Totally Slightly 
Unfamiliar Familiar 



More-than- 

Moderately Moderately Highly 

Familiar Familiar Familiar 
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INSTRUCTION TIME PROBLEM 



Related Knowledge 



How much knowledge do you have regarding the various aspects of the 
problem you just completed? In other words, how familiar are you 
with the type of problem and with the specific elements involved in 
the problem? 

Place an "X*' in the appropriate box on each of the items below. 



1, Estimate how much you know about instruction procedures and 
equipment which could help solve the instruction time problem. 





A Small 


A Moderate 


More-than- 

Average 


A 

Considerable 


No 


Amount of 


Amount of 


Amount of 


Amount of 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


□ 


p 


□ 


□ 


D 



2. Estimate how much you know about transportation systems which 
might be used to solve the problem. 

More- than- A 

A Small a Moderate Average Considerable 

No Amount of Amount of Amount of Amount of 

Knowledge Knowledge Knowledge Knowledge Knowledge 

□ □ □ □ □ 



3. Estimate how much you know about possible architectural solutions. 





A Small 


A Moderate 


More-than- 

Average 


A 

Considerable 


No 


Amount of 


Amount of 


Amount of 


Amount of 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


Knowledge 


□ 


□ 


p 


a 


□ 



4. Estimate how familiar you are with problems like the instruction 
time problem. 

More-then- 

Totally Slightly Moderately Moderately Highly 

Unfamiliar Familiar Familiar Familiar Familiar 

o 

ERIC 
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APPENDIX B 



Form used to Assets Ss* Knowledge of 
Criteria for Solution Originality 



CRITERIA UWLEDGE 



Paper Product Problem 



Several eolutlone to the paper product problem appear below. Indicate 
on the first scale by each solution how original you tnlnk the solution 
Is and indicate on the second seal* fc *w well you think the product 
would sell to S.I.U students. 







Originality 


fales Potential 


1. 


Stationery with SIU letterhead. 


Lo Med HI 
□ □□ 


Lo Med HI 

□ □P 


2. 


A raffle book with 10$ chances 
for free trip to Florida over 
spring break. 


bBb 


Lo Med HI 
□ □□ 


3. 


Confetti for football games. 


to Med HI 

□DO 


to Med HI 

i DPP 


4. 


Mobile with pictures of SIU 
officials with funny captions. 


bBb 


i bBa 


5. 


Psychedelic posters. 


Lo Med HI 
□ □□ 


i baa 


6. 


An SIU calendar with Important 
events. 


to Med HI 
□ □□ 


to Med HI 
1 □□□ 


7. 


Three-dimensional objects such as 
piggy-banks, Kleenex box, etc. 


to Med HI 

poo 


to Med HI 
1 □□□ 


8. 


Already-written letters to parents 
to fit various occasions. 


-bBb 


i aea* 


9. 


A package of paper airplanes 
with printed fold-marks. 


Lo Med HI 
□ □□ 


i baa 


10. 


Protest pamphlets with blanks 
to fill in whatever' s being 
protested. 


to Med HI 
□ □□ 


1 ODD 
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CRITERIA KNOWLEDGE 



School Pride Problem 



Severel solutions to the school pride problem appeer below. Indicate 
on the scale by each solution how original you think the solution is. 



Originality 



1. Since pride is often fostered by possession, a 
student- faculty corporation could be formed. 
Shares would be sold in the organisation; it 
would be owned by the shareholders. This cor- 
poration could function in an advisory capacity 
to officials of the University. It could use 
its capital to promote its Interests and ob- 
jectives. 

2. Offer rewards (monetary) for acts of pride from 
the President’s central account. 

3. Exhibit of work of three or four top students 
in each department — original stories, poems 
from English Dept., original experiments from 
science departments, visual work from Art, 
original plays from Drama, etc. 

4. Raise entrance requirements. Therefore, the 
kids that get in will be the ones who are 
proud to get an education, not the ones who 
just like college life but could care less 
about an education. 

5. Have a Student Appreciation Day where students 
run the University for one day a year. 

6. Supplementary forms of fraternities and scrorl- 
tles should be formed with restrictions on class 
(Fr., Soph., etc.) to make a student want to be 
one of the above. 




Lo Med Hi 

□ PD 




CiBdS 

Lo Med Hi 

□ □□ 



7. 



A series of public panel discussions made up of 
University officials, faculty, and students dis- 
cussing pride, what the University is, how it runs, 
how important a part students and faculty play, etc. 




8. Publicise little-known facts about Southern — 
things that are important. Give the students 
something to be proud of. 
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9. Clean up the University so it deserves re- 
spect. Get rid of sons of the ugly, old 
buildings. Clean up some of the nudholes 
around sidewalks and buildings. Remake 
broken objects Instead of just patching them 
up. 

10. The University could sponsor a flag design 
contest. Once a design is selected, a pledge 
could be written and forced to be said at 
the start of every class period. The results 
would be a "far-right" University — or uni- 
versal is tic government. 





CRITERIA KNOWLEDGE 



Instruction Time Problem 



Several solutions to the instruction time problem appear below. 
Indicate on the first scale by each solution how original you think 
the solution is. Indicate on the second scale how effective you 
think each solution would be. 



Originality 



Effectiveness 



1. 


Monorail in major campus areas. 


Lo Med HI 
□ □□ 


2. 


Build close-in parking buildings. 


Lo Med HI 
□ □□ 


3. 


More Independent study — teachers 
stay in offices, students in dorms. 


Lo Med HI 

□ □□ 


4. 


Take the chains down and let people 
walk where they need to. 


Lo Med HI 

□□n 


5. 


Eliminate classrooms and classes and 
instruct each student via his home 
television set. 


Lo Med HI 

□ □□ 


6 . 


Movable sidewalks. 


Lo Med HI 

□ □□ 


7. 


Call the library and get the book 
you want by messenger. 


Lo Med HI 
□ □□ 


8 . 


Since it easier to move one professor 
than 20 - 300 students, have more 
classes in living areas. 


Lo Med HI 
□ □□ 


9 . 


Everybody run — both to save time 
and to keep fit! 


□Bc3 


10. 


If places must be so far apart, have 
a tube which you get sucked into and 
are sucked to the place you want to 


Lo Med HI 

map 



go. 



Lo Med Hi 

pan 




Lo Med Hi 



Lo Med Hi 




50 



3 

ERIC 



' *r- it**^-**^- h4)Wk-> 









CRITERIA KNOWLEDGE 
Laundromat Problem 



Several solutions to the laundromat problem appear below. Indicate 
on the scale by each solution how original you think each solution Is 




Or In Inal itv 


1. One addition which I feel would greatly Influence 
the choice would be a TV with all of SIU's lec- 
tures at their regular times , also the other 
three networks. 


Lo Med HI 

PPP 


2. Music should be piped In through speakers In the 
celling In restricted areas. 


Lo Med HI 

□ □□ 


3. The Dallv Eavntlan should be delivered there. 


hfidU 


4. Showing short movies like Charlie Chaplin, Road 
Runner, Bogart, etc., something currently In. 


bSfi 


5. Playboy girls In person. 


Lo Med HI 

pan 


6. Live music and dancing. 


Lo Med HI 

□an 


7 . Free typewriters . 


Lo Med HI 
□ □□ 


8. Transportation. Buy a VW Bus $2,000. Free 

transportation to and from the laundry each Satur- 
day. Bus would follow a certain route and stop 
at particular corners each hour. $3,000 for 
salary for one person to drive bus each Saturday 
and for upkeep and gasoline. 


Lo Med HI 

pan 


9. The possibility of a coin-operated hair dryer 
could be an asset to business. Women could dry 
their hair while waiting for clothes. 


Lo Med HI 
□ □□ 


10, Study carrels — sound-proof. 


Lo Med HI 

pap 
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CRITERIA KNOWLEDGE 



Library Materials Problem 

Several solutions to the library materials problem appear below. 
Indicate on the first scale by each solution how original you think 
the solution is. Indicate on the second scale how effective you think 
each solution would be. 



Originality Effectiveness 



1 . 



The xerox copy service should be 
encouraged more in the library. 
Articles, illustrations, etc., copied 
free for the student, costing the 
library approximately 5c per copy, 
might prove cheaper in the long run 
than replacement of expensive refer- 
ence materials. The service would 
have to be advertised via signs, and 
speedy service offered. 



Lo Med Hi 



Lo Med Hi 



2 . 



An editorial campaign, cartoons, and 
articles on this problem in the stu- 
dent newspaper emphasizing the harm 
done to the average student — less 
money to buy more books and periodi- 
cals, unavailability of materials, 
etc., could put pressure on students 
from their peers rather than the 
library authorities. 




Lo Med Hi 



3. Closed stacks — inspection before 
and after use. 



Lo Med Hi 

□pn 



4. Wire the book to give a severe elec- 
tric shock if they are torn or 
marked. 




Lo Med Hi 



Lo Med Hi 



5. Place all reference material on 
microfilm. 




6. Employ some type of electronic moni- 
toring in reference and periodical 
sections, such as cameras, mirrors, 
etc. 



Lo Med HI 

□ □Q 



Lo Med Hi 
□ □□ 



7. Making public the names of people 
caught abusing materials and stiff 
penalties, perhaps enforced by 
a student-type court would be effec- 
tive. 





0 
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8. Floritcope when leaving the li- 
brary — library materials all 
treated with barium. 




9. Use non-tearable paper (nylon?) 



hesa 



10. Provide duplicate periodicals 
for check-out just like books. 

Many students simply don't have 
time to sit in the library for 
three hours and copy an article for 
later reference. 



Lo Med Hi 

PPP 
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APPENDIX C 



Form used for Ss* to Indicate 
The Type of Problem Solving Process 
Employed on each Problem 



Problem Solving Process 



What kind of problem-solving process did you follow in producing 
solutions for the problem you just completed? In other words, what 
kind of thinking process did you use? 

^ ^ Check here if you followed a completely non-eyatematic process 
in which you tried to think of solutions in a sort of intuitive or 
random trial -and-error fashion. 

_ ^ ^ Check here if you followed some kind of systematic thinking process 
in producing solutions, and briefly describe as best you can the 
process you followed. 



APPENDIX D 



Instructions and Rating Form used 
To Obtain Design Instructor's Ratings 
Of Ss Creative Design Performance 
In Design Courses 



MEMO 



TO; 

FROM: David T. Miles, Educational Research Bureau 

DATE : 



A number of creativity test* have recently been administered to 
several design students. One element of Information 1 1X “ t0 

obtain about these testa Is the degree of correlation betveen the 
students’ creative performance on the tests and th * lr * J* . 

formance as design students. The way I Intend to do this Is have the 
design faculty estimate the level of each student s scores on t e 
tests with a statistical correlation test. 

I am going to ask you to rate each student “"S' 0 . ! . f 

(1) his level of creative design performance, and (2) his level o 

overall design performance. 

By "creative design performance," I am referring to the 
Ity of a student’s Ideas or the variety of different Ideas a student 
produces In solving design problems. "Overall design £**°™” e * 
refers to the Implementation of Ideas, such as the craftmanehlp of ^ 
a student’s work and other attributes s*lch go to make up per 

formance In addition to the quality of Ideas produced as problem 

solutions. 
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Indicate your estimate of the level of Creative Design Performance 
and the level of Overall Design Performance for each of these 
students. 



Low High 



Creative Design Performance 


_Lo£_ 

0 


Average 

0 


Average 

0 


Average 

0 


High 

0 


Overall Design Performance 


0 


0 


0 


0 


0 


Creative Design Performance 


o 


o 


0 


0 


0 


Overall Design Performance 


0 


0 


0 


0 


0 


Creative Design Performance 


o 


0 


0 


0 


0 


Overall Design Performance 


o 


0 


0 


0 


0 


Creative Design Performance 


0 


0 


0 


0 


0 


Overall Design Performance 


0 


0 


0 


0 


0 


Creative Design Performance 


o 


0 


0 


0 


0 


Overall Design Performance 


0 


0 


0 


0 


0 


Creative Design Performance 


o 


0 


0 


0 


0 


Overall Design Performance 


0 


0 


0 


0 


0 


Creative Design Performance 


0 


0 


0 


0 


0 


Overall Design Performance 


0 


0 


0 


0 


0 


Creative Design Performance 


0 


0 


0 


0 


0 


Overall Design Performance 


0 


0 


0 


0 


0 


Creative Design Performance 


0 


0 


0 


0 


o' 


Overall Design Performance 


0 


0 


0 


0 


0 
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Example of the Form uaed to Present 
And Record Evaluations Of Prior Solutions 
To Bach Problem 
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Name; 



Previous Solutions for Paper Product Problem 



Instructions ; In the space provided beneath each of the five solutions 
listed below briefly specify two or three reasons why each solution is 
a good one. In other words, point out two or three positive features 
for each solution. 

1. Make a paper lab apron for chemistry students to protect their 

clothes. It can be taken off quickly if something is spilled on it. 



2. Make up a disposable travel kit, including towel, razor, toothbrush, 
comb — all made of paper. 



tp-wmi 



5. Print each sheet with a geometric design and sell them with a 
roll of black tape. This is a wallpaper kit. Each piece is put 
in desired position and taped to the wall. 



